Methods, system, and articles of manufacture for developing analyzing, and managing initiatives for a business network

ABSTRACT

A system, method, and article of manufacture is disclosed for developing and managing a the test of a business initiative for a business network including business locations. In one aspect of the invention, a method is performed that includes performing a process for developing a business initiative to apply to the business network and performing a process for designing a test for the initiative. Further, the method includes executing the initiative at a set of test sites in accordance with the designed test, each test site corresponds to a selected business location in the business network. Also, performance results of the executed initiative may be analyzed and a rollout plan is created for implementing the initiative at a first set of business locations.

RELATED APPLICATION

This application is a continuation-in-part of U.S. patent applicationSer. No. 10/767,191, entitled “Methods, Systems, and Articles ofManufacture for Analyzing Initiatives for a Business Network,” and filedJan. 30, 2004, which is hereby incorporated by reference in itsentirety.

FIELD OF THE INVENTION

This invention relates to business initiative analysis systems, and moreparticularly, to methods, systems, and articles of manufacture fordeveloping, analyzing, and managing initiatives for implementation atselected business locations in a business network.

BACKGROUND OF THE INVENTION

For as long as retailers have been selling products and services, theyhave been seeking ways to increase profits. Accordingly, many retailerscreate new initiatives that they believe will have a positive impact onprofits. These initiatives usually cover various aspects of businessoperations that drive profits. For example, retailers may change productprices, move products to different locations of a sales floor, changethe amount of space allocated to each product, test new products, add orreduce sales staff, introduce new concepts (e.g., in-store kiosks),remodel older stores, and test new marketing campaigns. Retailers maytest these new initiatives in selected test locations (i.e., certainstores) and subsequently determine whether to introduce the initiativesto remaining business locations based on the success of the initiativesat the selected test locations. Historically, retailer managers haveused business instinct and/or anecdotal evidence to assess the successof the initiatives in order to make a decision whether to implement theinitiatives at the rest of its business locations.

In recent years, however, some retailers have become more structured andanalytical in their set up and analysis of tests. These retailerscollect performance metrics, such as sales and gross profit data fromthe test locations and analyze the data using conventional softwareproducts, such as spreadsheet or statistical software packages.Retailers may measure the change in the performance metrics at thelocations that introduced the new initiatives relative to a change inthe same metrics at a control group of locations that did not implementthe initiatives. In doing so, the retailers attempt to identify theimpact of the initiatives on the performance metrics in order todetermine whether they provide a positive return on investment.Accordingly, these retailers can make an informed decision whether toextend the concept to remaining locations in a business network.

As retailers improve their approach in analyzing initiatives, they haveincreased the frequency and scope of the initiatives under test. Often,several functional teams associated with a retailer may independentlydesign, execute, and analyze initiatives under consideration forimplementation at the retailer's business locations. For example, amarketing team may test a new advertisement for a product in certainmarkets, while an operations team tests a new training initiative. Atthe same time, a merchandising team may be modifying product displaysand a store development team may be remodeling the layout of theretailer's locations. Accordingly, it is becoming increasingly difficultto coordinate the analysis of initiatives among the several functionalteams that may implement, or is implementing, one or more initiatives.The consequence is that teams are unaware that tests are run in the samelocation at the same time. This simultaneous testing affects the outcomeregarding the actual impact a particular initiative may have at givenlocation. For instance, an operations team may associate a significantsales increase in a particular test market to a recently executedtraining initiative without realizing that a marketing team had runadditional advertising in the same market. Such concurrent testing maycause the operations team to over-estimate the impact of their testingtraining program and make inefficient decisions regarding whether toextend the training program to other markets.

Further, functional teams may find it increasingly difficult tocommunicate and coordinate with the retail locations actuallyimplementing an initiative. For example, suppose that an operations teamdesires to test the impact of additional labor in a set of retaillocations during a particular holiday season. Accordingly, theoperations team may allocate a larger budget for the acquisition ofadditional labor for particular locations. The managers of theselocations, however, still need to actually spend the allotted budget onadditional labor. Any deviation from this purpose affects the outcome ofthe analysis of the initiative. Without tools to enable the execution ofan initiative, functional teams may find it difficult to ensure thatlocations are aware of an initiative and are actually executing theinitiative as proposed by the team.

SUMMARY OF THE INVENTION

It is therefore desirable to have a centralized system that allows aretailer to coordinate the development, planning, execution, andanalysis of the initiatives across different personnel, teams (e.g.,functional, operations, etc.), and business locations to ensureinitiatives are not duplicated and are properly executed. Accordingly,there is a need for a system that manages the designing, running, andanalyzing of initiatives in a business network.

In one aspect of the invention, a method is provided for developing andmanaging a business initiative in a business network including businesslocations. The method may be performed in connection with a set ofinstructions stored on a computer-readable medium and executed by aprocessor and includes performing a process for developing a businessinitiative to apply to the business network and performing a process fordesigning a test for the initiative. Further, the method includesprocess support for executing the initiative at a set of test sites inaccordance with the designed test, each test site corresponds to aselected business location in the business network. Also, performanceresults of the executed initiative may be analyzed and a rollout plan iscreated for implementing the initiative at a set of business locations.

In another aspect of the invention, a method is provided for designing atest for a business initiative that is to be executed in a businessnetwork including business locations. The method may be performed inconnection with a set of instructions stored on a computer-readablemedium and executed by a processor, and comprises selecting a set oftest sites that correspond to business locations that are to execute theinitiative during the designed test. Further, the method may includeselecting a set of control sites that correspond to business locationsthat do not execute the initiative during the designed test. Thesecontrol sites are used to set a baseline against which the change inperformance at the test sites will be measured. Additionally, the methodmay include determining the strength of the relationship between theperformance of the control sites and the performance of the test sitesduring a selected period of time before an execution date of theinitiative at the test sites.

In yet another aspect of the invention, a method is provided formanaging the execution of a business initiative in a business networkhaving business locations including a set of test sites corresponding tobusiness locations that execute the initiative. The method may beperformed in connection with a set of instructions stored on acomputer-readable medium and executed by a processor, and includesproviding a database including information reflecting a progress of theexecution of the initiative at the set of test sites and informationreflecting a status of other initiatives being executed in the businessnetwork. The method may also include updating the database based oninformation received from any one of the test sites reflecting a statusof the initiative at the respective one test site. Also, the methodincludes updating the database based on information received from any ofthe business locations reflecting the status of the other initiativesbeing executed in the business network.

An additional aspect of the invention includes a system for developingand managing a business initiative in a business network includingbusiness locations. The system comprises a computer system that isconfigured to perform processes for managing and developing theinitiative. In one aspect, the processes may include a process fordeveloping a business initiative to apply to the business network and aprocess for designing a test for the initiative. Also, the computersystem may perform a process for managing the execution of theinitiative at a set of test sites in accordance with the designed test;wherein each test site corresponds to a selected business location inthe business network. Further, the computer system may perform a processfor analyzing performance results of the executed initiative and aprocess for creating a rollout plan for implementing the initiative at aset of business locations.

Additional aspects of the invention will be set forth in part in thedescription which follows, and in part will be obvious from thedescription, or may be learned by practice of methods, systems, andarticles of manufacture consistent with features of the presentinvention. The aspects of the invention will be realized and attained bymeans of the elements and combinations particularly pointed out in theappended claims. It is to be understood that both the foregoing generaldescription and the following detailed description are exemplary andexplanatory only and are not restrictive of the invention, as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of this specification, illustrate several aspects of the inventionand together with the description, serve to explain the principles ofthe invention. In the drawings,

FIG. 1 illustrates an exemplary system environment in which methods,systems, and articles of manufacture, consistent with features andprinciples of the present invention may be implemented;

FIG. 2 illustrates a flowchart of an exemplary initiative developmentand analysis process, consistent with certain aspects of the presentinvention;

FIG. 3 illustrates a flowchart of an exemplary initiative selectionprocess, consistent with certain aspects of the present invention;

FIG. 4A illustrates a flowchart of an exemplary initiative test designprocess, consistent with certain aspects of the present invention;

FIG. 4B shows a screen shot of an exemplary site selection Web page,consistent with certain aspects of the present invention;

FIG. 4C shows a screen shot of an exemplary site activity calendar Webpage, consistent with certain aspects of the present invention;

FIG. 4D shows a screen shot of an exemplary control group fit Web page,consistent with certain aspects of the present invention;

FIG. 5A illustrates a flowchart of an exemplary initiative executionprocess, consistent with certain aspects of the present invention;

FIG. 5B shows a screen shot of an exemplary initiative executionchecklist Web page, consistent with certain aspects of the presentinvention; and

FIG. 6 illustrates a flowchart of an exemplary comparable initiativeanalysis process, consistent with certain aspects of the presentinvention.

DETAILED DESCRIPTION

Methods, systems and articles of manufacture consistent with certainaspects of the present invention manage the development, execution,analysis, and implementation of initiatives for a business network.

In accordance with one aspect of the invention, a system performs one ormore processes for developing, testing, analyzing, and monitoring abusiness initiative for a business network. The network may includebusiness locations, some of which may be designated as test sites thatimplement the business initiative for a predetermined test period andsome of which may be designated as control sites that do not implementthe initiative. Each of the sites have an associated set of attributesreflecting various characteristics corresponding to the respective site,such as geographical location, size of business location, number ofemployees, etc. In one aspect of the invention, the system performsprocesses that assists a business in selecting an initiative. Forexample, the system may provide access to data associated with otherinitiatives that may have been developed, tested, executed, analyzed,and/or implemented within (or outside) the business network. Further,the system may perform processes that prioritize potential initiativesfor selection and provides notifications to the business locations of aselected initiative.

In accordance with another aspect of the invention, the system performsprocesses that design a test for a selected initiative. In this aspect,the system may determine the number and types of test sites and/orcontrol sites that should be associated with the selected initiativeunder test. The system may perform a process that determines how manytest and control sites are needed in order to have statisticalconfidence in the results when analyzing the test. The system alsoprovides information reflecting the initiatives being tested in thebusiness network. The system may provide a graphical view of thebusiness locations of the business network in relation to theinitiatives assigned, executing, and/or implemented by these locations.This allows the user to know if other initiatives are scheduled fortesting or implementation at the test and/or control stores at the sametime.

In accordance with another aspect of the invention, the system maymanage the execution of an initiative under test. The system may providea checklist to business locations designated as test sites that includestasks that are to be performed while executing an initiative under test.The system also provides notifications to the test sites, and receivescorresponding feedback from these sites, reflecting events correspondingto the tested initiative. Based on the feedback, the system monitorsexecution of the initiative at the test sites and updates informationreflecting the performance of the initiative at each of the sites.

Also, the system collects performance values for each of the test andcontrol group sites reflecting a level of performance of each siteduring the test period for the initiative. The system then calculatesthe change in performance in the test sites during the test period,relative to the change in performance in the control group sites overthe same time period. The system may segment the performance values foreach test site attribute to identify those attributes that have agreater impact on the performance values of the test sites than otherattributes. Further, the system configures a model for predicting theperformance values of the test sites using the identified attributes anddetermines whether the model accurately predicts these performancevalues. If so, the system applies the model to all non-tested sites(i.e., all business locations in the business network) to predict theperformance values of each site. Based on the predicted performancevalues, a user or software process associated with the business networkmay select one or more of those sites to implement the businessinitiative. Additionally, once models have been created that estimatethe impact of initiatives if each were implemented at each businesslocation, the system performs processes that model the impact ofcomparable initiatives at each location and identifies the bestinitiative for rollout at each location based on the performance resultsof the models.

Additionally, the system manages the rollout of a tested initiative byproviding information to the business locations that reflects schedulesand tasks for implementing the initiative. Users at the businesslocations may update the information based on their respective location.These updates are reflected in a data structure that is accessible byeach of the business locations and a business management unit tocoordinate the rollout at the business locations. For instance, a userassociated with a given business location may adjust the rollout date ofa tested initiative for their business location in the event a proposedrollout date may disrupt the current performance of their location.

Reference will now be made in detail to the exemplary aspects of theinvention, examples of which are illustrated in the accompanyingdrawings. Wherever possible, the same reference numbers will be usedthroughout the drawings to refer to the same or like parts.

The above-noted features and other aspects and principles of the presentinvention may be implemented in various environments. Such environmentsand related applications may be specially constructed for performing thevarious processes and operations of the invention or they may include ageneral purpose computer or computing platform selectively activated orreconfigured by program code to provide the necessary functionality. Theprocesses disclosed herein are not inherently related to any particularcomputer or other apparatus, and may be implemented by a suitablecombination of hardware, software, and/or firmware. For example, variousgeneral purpose machines may be used with programs written in accordancewith teachings of the invention, or it may be more convenient toconstruct a specialized apparatus or system to perform the requiredmethods and techniques.

The present invention also relates to computer readable media thatinclude program instructions or program code for performing variouscomputer-implemented operations based on the methods and processes ofthe invention. The program instructions may be those specially designedand constructed for the purposes of the invention, or they may be of thekind well-known and available to those having skill in the computersoftware arts. Examples of program instructions include for examplemachine code, such as produced by a compiler, and files containing ahigh level code that can be executed by the computer using aninterpreter.

I. System Overview

FIG. 1 illustrates an exemplary system environment 100 in which certainaspects related to the present invention may be implemented. As shown,system environment 100 may include a business network 110, network 120,and a server 130.

Business network 110 represents a network of businesses that providesimilar products and/or services to customers. The businesses may begeographically dispersed. Business network 110 may include one or morebusiness regions 112-1 to 112-N that represent different geographicallocations, such as cities, counties, states, country regions, virtualboundaries having a predetermined bounded distance (e.g., 100 mileradius), and any other type of defined region within a particularlocation. Each region 112-1 to 112-N may include one or more businesslocations 114 that represent retailers that sell products and/orservices associated with business network 110. For example, businessnetwork 110 may represent a grocery store chain that includes aplurality of stores geographically dispersed among a state of the UnitedStates. Each region 112-1 to 112-N may represent locations that includegrocery stores in the chain (e.g., business locations 114) that arewithin a predetermined distance of one another (e.g., 100 mile radius).

Also included in business network 110 is business management unit 116,which represents a business entity that manages business network 110.For example, business management unit 116 may be an organizationheadquarters or a particular division for business network 110, such asa marketing division, an operations division, etc. Unit 116 may includeone or more clients 118 that are operated by one or more usersassociated with business network 110 that perform various managementand/or marketing duties for business network 110. Following the aboveexample, business management unit 116 may be a marketing division of theexemplary grocery store chain that determines which products and/orservices each retailer location (e.g., location 114) should provide.

In one aspect of the invention, client 118 may be one or more computersystems such as a desktop computer, workstation, laptop, personaldigital assistant or any other similar computing system operated by auser. Client 118 may include a processor, associated memory, and otherelements and functionalities available in computer systems (all notshown). These elements may include input/output devices, such as akeyboard, mouse, and display, although these input means may take otherforms. Also, client 118 may include a network interface forcommunicating with external resources, such as network 120 and server130. Further, client 118 may execute browser software that enables auser to request, receive, and render information from network 120.

Although FIG. 1 shows business network 110 including a single businessmanagement unit 116 (and accompanying client 118), each businesslocation 114 may include a client 118 that is capable of accessingnetwork 120 and server 130 to access and perform processes consistentwith certain aspects related to the present invention. Further, althoughbusiness network 110 is shown including a plurality of regions 112-1 to112-N, network 110 may include business locations 114 that are allincluded within a single region. Also, business locations 114 and client118 may all be interconnected by a communication network (not shown).

Network 120 may be a shared, public, or private network and encompassesa wide area or local area. Network 120 may be implemented through anysuitable combination of wired and/or wireless communication networks.For example, network 120 may be implemented through a Wide Area Network(“WAN”), Local Area Network (“LAN”), an intranet and/or the Internet.Further, network 120 may represent multiple networks, such as a wirelesscarrier network connected to the Internet. As such, through thecommunication network interconnecting business locations 114 and client118, business locations 114 may also be connected to server 130 vianetwork 120.

Server 130 may be a computer system such as a desktop computer,workstation, or any other similar server side computing system thatperforms one or more server-side processes. In one aspect of theinvention, server 130 may include, among other things, interface unit132, processing unit, 134, memory 136, and database 140. Although server130 is shown including elements 132-140, it may include additionalcomputing elements, such as an input/output device (e.g., display,mouse, keyboard) that enables a user to access the data and software inserver 130. In addition, server 130 may be a group of servers.

Interface unit 132 may be one or more hardware and/or softwarecomponents that are configured to receive and send information from/tonetwork 120. Interface unit 132 may include, or leverage, differenttypes of software to control access to information maintained by server130. For example, interface unit 132 may execute firewall software thatcontrols access to information and processes provided by server 130using one or more security protocols (e.g., password processing,encryption technologies, etc. The above listed functionalities are notintended to be limiting and interface unit 132 may perform other typesof interface processes to facilitate the exchange of information betweenserver 130 and network 120.

Processing unit 134 may be one or more processing devices that executesoftware processes stored in one or more memory devices, such as memory136. Further, processing unit 134 may execute software processes storedinternally, such as internal flash memory configured within processingunit 134.

Memory 136 may be one or more memory devices that store data andsoftware programs that, when executed by processing unit 134, performprocesses consistent with certain aspects related to the presentinvention. These programs may include segmentation engine 137, and modelprocessing engine 138. Further, memory 136 may include server-sidesoftware applications that enable server 130 to create and providecontent including information produced by other programs executed byprocessing unit 134, such as web server software. Alternatively, server130 may leverage web server software that is located in another memorydevice (not shown) internal or external to server 130. The abovesoftware programs and functionalities are not intended to be limitingand memory 136 may be configured to store additional or fewer types ofdata and/or software programs that perform other processes consistentwith server-side computing systems.

Database 140 may be one or more memory devices that store data and/orexecutable software that is used by server 130 to perform processesconsistent with certain aspects related to the present invention. Forexample, database 140 may include one or more data structures (e.g.,tables, maps, arrays, directories, etc.) that include data that is usedby one or more of the software programs stored in memory 136 andexecuted by processing unit 134. Although server 130 shows database 140and memory 136 as separate elements, the information and software storedin these elements may be combined in a single memory device. Also,memory 136 and/or database 140 may be located external to server 130 andaccessible through network 120 or a dedicated back-end communicationpath, such as a Local Area Network (LAN).

Furthermore, the processes and functionalities associated with server130 described herein are not limited to execution by server 130. Inother aspects of the invention, client 118 may implement similarhardware and/or software components to perform processes executed byserver 130 described below.

II. Initiative Development and Analysis Process

Methods, systems, and articles of manufacturer consistent with aspectsof the present invention enable one or more users of client 118 toaccess functionalities offered by server 130 to develop one or moreinitiatives, design tests for these initiatives, execute the tests,analyze the results of the tests, and determine rollout plans forimplementing the initiative in business network 110. For example, a userin business management unit 116 may execute browser software in client118 to implement processes executed by server 130 to develop and analyzean initiative. FIG. 2 shows an exemplary initiative development andanalysis process that may be performed by methods, systems, and/orarticles of manufacture consistent with aspects of the presentinvention.

Initially, a user or users at business management unit 116 may select aninitiative that is to be applied to a group of test sites reflecting aset of business locations 114 (e.g., thirty stores) included in businessnetwork 110 (Step 210). The proposed initiative may be a change in storelayouts, offering different products and/or services, differentmarketing campaigns (e.g., advertising, sales promotions, etc.), and anyother type of idea that may be implemented at the selected test sites.

The user of business management unit 116 may then design a test for theselected initiative by selecting where and when the initiative is to betested (Step 220). The user of business management unit 116 may thendirect the selected test sites to execute the test of the proposedinitiative (Step 230). The initiative may be implemented for apredetermined amount of time (e.g., three months, six months, etc.),which is also known as a test period. Alternatively, the initiatives maybe implemented at the test sites indefinitely. During the test period,business management unit 116 may collect feedback results from each testsite based on one or more performance metrics selected by unit 116. Forexample, business management unit 116 may request sales information,foot traffic (i.e., number of persons entering a business location),etc. from each test site during the test period and may requestadditional performance data for each test site for a period before thetest period. Additionally, business management unit 116 collects resultdata for control sites that are identified during the design of theinitiative test.

Once the appropriate feedback results are collected, a user at businessmanagement unit 116 may implement client 118 and/or server 130 toanalyze the test results of the executed initiative (Step 240). Theinitiative analysis process provides information regarding theeffectiveness of the initiative at the test sites. Further, theinitiative process provides information regarding a proposedeffectiveness of the initiative if implemented in other non-testedbusiness locations in business network 110 (i.e., retailer locationsthat did not implement the initiative). These other business locationsmay be referred to as non-test group sites. In one aspect of theinvention, the initiative analysis process includes the exchange ofinformation between client 118 (under the operation of a user) andserver 130. For example, a user operating client 118 may implementbrowser software to access one or more web sites that are provided orleveraged by server 130 to analyze the test results of the initiative.Accordingly, server 130 may provide content to client 118 that includesqueries, data, and analysis information associated with the initiativeanalysis process.

In certain aspects, to assist in analyzing the initiative test results,client 118 may download information to server 130 associated with theresults of the test initiatives at the test sites. Further, server 130may receive, or retrieve, attributes associated with each businesslocation 114 from client 118. An attribute may be characteristicsassociated with a business location, such as store size, locations, saledata, types of products and/or service offered, location and distancesof competing merchant sites, age of the business location, amount of alease (if any), weather during the test period, staff information, etc.Alternatively, or in addition to the information provided by client 118,server 130 may execute software that determines, collects, and/orretrieves attribute information associated with business network 110,regions 112-1 to 112-N (e.g., population and demographic data, etc.),and business locations 114. The attribute information may be stored indatabase 140 for subsequent use by server 130 and/or client 118.

A user, such as a manager at business management unit 116, or softwareprocesses executed by a processor, may analyze the information providedby server 130 and create an initiative rollout plan for implementing theinitiative at one or more applicable business locations 114 (Step 250).These may include some or all of business locations 114. Once therollout plan is created, the initiative may be rolled out to theapplicable business locations 114 (Step 260). Accordingly, businessmanagement unit 116 and/or server 130, determines and implements one ormore strategies associated with the tested initiative in a selectednumber of business locations 114, and/or groups of locations, such asregions 112-1 to 112-N.

III. Selecting an Initiative to Apply to a Group of Test Sites

As described above in connection with Step 210 of FIG. 2, aspects of theinvention enable a user of business management unit 116 to select aninitiative to apply to a number of test sites. FIG. 3 shows a flowchartof an exemplary initiative selection process, consistent with certainaspects of the present invention. In one aspect, a user may implementclient 118 to access information associated with previously testedinitiatives (Step 310). To do so, client 118 may access database 140,which stores historical data associated with previously developed andtested initiatives that may or may not have been rolled out in businessnetwork 110. Alternatively, the historical data may be stored in adatabase that is implemented by business management unit 116 and/or oneor more of business locations 114. The historical data may reflectparameters, details, performance results, test criteria, etc. associatedwith one or more initiatives previously tested and/or implemented bybusiness network 110. For example, the historical data may identify testsites that executed the previous initiative, control sites associatedwith the test of the previous initiative, performance metrics analyzedduring the test, the results of the analysis, performance modelsgenerated based on the analysis, etc. Additional details on how aninitiative is analyzed and modeled are described in U.S. patentapplication Ser. No. 10/767,191, previously incorporated by reference.

In addition to historical data, business management unit 116 may provideaccess to initiative resource databases that store informationassociated with initiatives previously tested, currently underdevelopment for testing, and/or proposed for testing (Step 320). Forinstance, the user of client 118 may request and search one or moredatabases including information reflecting internal businessmemorandums, research documents, marketing documents, and any other typeof document associated with initiatives developed or being developed forbusiness network 110. Alternatively, or additionally, client 118 mayhave access to one or more databases including information associatedwith initiatives developed and/or executed by entities other than thebusiness entity associated with business network 110. For example, theuser operating client 118 may search the World Wide Web via a standardsearch engine for initiative concepts, research, and/or performanceresults.

Additionally, aspects of the invention enable client 118 to leverageserver 130 to perform a process for prioritizing potential initiativesunder consideration by the user of client 118 (Step 330). For instance,client 118 may request and display a user interface, such as a Web page,that queries the user to provide initiative-based input. Based on theinput, server 130 and/or client 118 may perform a process thatdetermines the expected performance of each proposed initiative (e.g.,return on investment) and prioritizes the initiatives based on thedetermined performance. For example, the user may input the on-goingoperating costs of the initiative per business location 114 and theon-going operating costs of all business locations 114 in businessnetwork 110. The user may also input an estimated revenue gain from theinitiative for each business location 114 for a selected time period.Further, the user may provide a measure of percentage of revenue thatflows through to profit for each business location 114 (e.g., theprofits, after operating costs, that are associated with an estimatedrevenue stream). Based on the user input, server 130 and/or client 118executes a process that determines an estimated return-on-investmentand/or net present value of a proposed initiative. The process maycompare the estimated results across different proposed initiatives toprioritize the initiatives that potentially offer the highest estimatedreturn. Client 118 may display the initiatives as a ranked list in agraphical user interface for review by the user operating client 118.Further, the process may automatically select an initiative with thehighest return on investment and present the selection to the user viathe graphical user interface.

IV. Designing a Test for an Initiative

As explained above in connection with Step 220 of FIG. 2, once aninitiative is created and selected, a test for determining the efficacyof the initiative is designed. FIG. 4A shows a flowchart of aninitiative test design process, consistent with certain aspects of thepresent invention. An issue that occurs when developing initiatives ishow broadly to test the initiative in the business network 110. As such,aspects of the invention execute processes that determine the number oftest sites that need to be included in an initiative test in order toachieve statistically meaningful results for analysis (Step 410). Forinstance, the number of test sites needed for an initiative test may bedriven by the size of the change in a selected performance metric (e.g.,test site v. control site change in performance metrics) and the amountof variance normally seen in that selected metric. Accordingly, aspectsof the invention perform processes that provide a user of client 118with a mechanism for inputting selected settings that are leveraged byserver 130 and/or client 118 to produce an indication of statisticalconfidence in the expected performance of the initiative associated witha number of test sites and/or control sites selected for a giveninitiative.

To better illustrate the above described aspects of the invention, FIG.4B shows a screen shot of an exemplary site selection Web page 400,consistent with certain aspects of the present invention. Client 118 maygenerate Web page 400 in response to a request by the user to analyzethe confidence in measuring a determined change in performance at adetermined number of sites for a given test. In one example, for a givenproposed initiative, a user may input a type of performance metric(e.g., sales), a category being measured (e.g., entire businesslocation, type of product, etc.), a test period, and the number of testsites and control sites proposed for the initiative test. Based on thisinput, client 118 and/or server 130 determines the number of test sitesneeded for the proposed initiative to have a particular statisticalconfidence in a given lift in the selected performance metric. As shownin FIG. 4B, Web page 400 may include a result component that displaysnumbers of test sites 402 needed to achieve a given confidence value(e.g., 406) for a given lift in performance metric 404. For example, if,hypothetically, the user, or a software process, determines that a 3%lift is the most likely result of the initiative and requires an 80% 1-pvalue, or confidence that the lift is meaningful, then the software maydetermine that at least 25 test sites are needed for an 80% confidencein the measurement of a 3% lift. It should be noted, while Web page 400shows a results component in an array format, other forms of output maybe presented to a user in accordance with aspects of the invention. Forinstance, client 118 may display a graphical view that only presents thenumber of test sites required for a selected lift in a performancemetric for a given control group size. Further, based on the number ofselected control sites, client 118 and/or server 130 may determine thenumber of test sites required to achieve certain levels of confidencefor given performance metric lifts.

Once the appropriate number of test sites is determined, the user ofclient 118 may select the test sites to be included in the set of testsites for testing the initiative (Step 420). In one aspect, client 118may present to the user information identifying which business locations114 in business network 110 are executing a different initiative or isassigned as a test site for a different initiative. Client 118 maypresent this information as a graphical view that may be viewed andsearched by the user. Client 118 may present this information in theform of a data structure that includes all other initiatives occurringat each business location 114 in network 110. The user may sort and/orfilter the data structure by business location 114 or initiative. In oneaspect, the data structure may be in the form of a graphical interface,such as a calendar that lists dates and initiatives corresponding toselected business locations 114. The calendar may be color coded toindicate the status of each business location 114 in relation to a giveninitiative (e.g., initiative test set up, executing an initiative,implementing a rolled out initiative, etc.). To illustrate thisexemplary aspect of the invention, FIG. 4C shows a screen shot of anexemplary Web page 412 that includes a color coded calendar 414 listinga plurality of business locations and their respective status associatedwith an initiative. For example, calendar 414 may include first statusinformation 414A presented in one color and second status information414B presented in another color. It should be noted that aspects of theinvention are not limited to the calendar format shown in FIG. 4C, asother types of graphical views may be implemented by aspects of theinvention to present the status of business locations. For instance,textual information may be used to reflect the status of initiatives foreach business location 114.

In another aspect of the invention, client 118 and/or server 130 mayexecute a process that automatically assigns business locations 114 astest sites based on data included in the data structure. For instance,data may be stored in a database, such as database 140, that correspondsto each business location's 114 role in one or more initiatives. Theprocess executed by client 118 and/or server 130 may access the storeddata to determine which business locations 114 to include in testing theselected initiative. The decision may be based on predetermined rulesthat consider the number of initiatives each business location 114 iscurrently assigned, the types of initiatives that are assigned, theparameters associated with the assigned initiatives (e.g., performancemetrics measured, etc.), the attributes associated with each businesslocation 114, and any other information that may be programmed as a rulefor consideration in selecting test sites.

Once the user, or a software application executed by a processor,selects the business locations 114 to be assigned as test sites for theproposed initiative, the control sites are selected (Step 430). The useroperating client 118 may view the status information associated withbusiness locations 114 described above to select the appropriatebusiness locations that will be assigned as control sites in a controlgroup.

Once the control group is selected, client 118 and/or server 130determines whether the control sites included in the control group areappropriate for the proposed initiative (Step 440). To accuratelyanalyze test results, control sites should be selected that haveperformance patterns similar to the test sites during a time frameextending up to the date that the initiative is introduced at the testsites. Accordingly, in one aspect, server 130 and/or client 118 executesa process that determines how well the control group matches the testgroup in a selected time period leading up to a proposed start date forthe initiative test. That is, for a selected performance metric (e.g.,sales), the process determines how the control sites were trendingrelative to all of the test sites and to each individual test site.

Client 118 may generate a graphical view that reflects the performancemetric values of the test sites indexed to the control sites during theselected time period before the start date of the initiative. Thegraphical view may also present information reflecting the variability(i.e., standard deviation) of the indexed values and informationindicating how test site performance metric changes over time relativeto the control sites during the selected time period before the startdate of the initiative. For instance, FIG. 4D shows a screen shot of anexemplary Web page 422 including a graphical view of a control group fitconsistent with these aspects of the invention. As shown, Web page 422includes a graph 423 that represents a time series view of how theselected test sites performed when indexed against the control sites'performance during the selected time period prior to the initiativeexecution start date, also called an “event” date 428. This is shown asfunction 424 in graph 423. The index between the test group and controlgroup is represented by the y-axis centered on a O-line. Data points onfunction 424 that are above the O-line indicate test sites that haveperformance metric values above the expected performance valuesgenerated by the control group. Similarly, data points on function 424below the O-line indicate that the performance metric values for thetest sites were below those associated with the control sites.Additionally, graph 423 may include a slope function that is representedby dotted line 426. Slope 426 indicates how test site performancechanges over time relative to control sites during the selected timeperiod before event date 428. The closer the slope is to zero, thebetter the relation is between the test and control sites' performancemetrics. Further, the space between the slope line 426 and the values offunction 424 represent noise, which is a measurement of the variabilityof the y-values of the indexed test v. control site performance metricvalues.

Also, Web page 422 may also include data values reflecting theinformation graphically displayed in graph 423. The data values mayinclude a value reflecting the noise 432 and slope 434 corresponding tothe data in displayed in graph 423. Additionally, the data values mayinclude confidence interval slope values 436 that reflect a range ofpossible slope values over a time period (e.g., one month) if a certainpercentage confidence interval was associated with the measured slope.For instance, the difference between the “90% CI Low Slope” and “90% CIHigh Slope” values 434 reflect the range of slope values for a measuredmonthly slope within a confidence interval of 90%. Additionally, Webpage 422 may also include a slope confidence value 438 that reflects a1-P value confidence that the measured slope value is between adesignated percentage range, such as −5% and 5%. Web page 422 may alsodisplay a table 439 that lists test site information corresponding tothe control group fit analysis represented in graph 423. Web page 422 isnot intended to be limiting as aspects of the invention may implementother types of user interfaces to convey the control group fitassessment information to a user.

Referring back to FIG. 4A, based on the control group fit analysis (Step440), the user, client 118, and/or server 130 determines whether thecontrol sites selected for the control group are appropriate for theinitiative executed at the test sites selected in Step 420 (Step 450).For instance, client 118 and/or server 130 may determine that thecontrol group is appropriate for the initiative if the relationshipbetween the performance of the control sites and the performance of thetest sites during the pre-execution time period is within apredetermined threshold value. For example, if slope range of values 436is within a predetermined value, the control sites may be deemedappropriate. Additionally, or alternatively, the control sites may bedetermined to be appropriate if the noise 432 is below a predeterminedvalue. Alternatively, or additionally, client 118 may receive input froma user reflecting a decision whether the control sites are appropriatefor the initiative based on a review of Web page 422 or a similar userinterface reflecting the results of the analysis by client 118 and/orserver 130.

If the control sites are not determined to be appropriate, (Step 450;NO), client 118 may allow the user or a software process to select a newcontrol group of control sites (Step 460), and the process returns toStep 440 to determine whether the new control sites are appropriate. If,however, the control sites are appropriate (Step 450; YES), the user mayselect the time period for the initiative test (Step 470) and theprocess ends. Time periods may be set individually for each test site.That is, a test period for the initiative may be the same for each testsite, or each individual test site may begin execution of the test atdifferent times. For instance, a first test site may begin executing aninitiative having a test period of five months on January 15^(th), whilea second test site begins the same initiative on February 15^(th). Thus,the first test site will complete the initiative on June 15^(th) and thesecond test site will complete the same initiative on July 15^(th).

In another aspect of the invention, client 118 and/or server 130 mayexecute a process that automatically selects a control group based onmatching performance patterns in the period before the execution date ofthe initiative. For example, once the test sites have been selected, theexecuted process may perform processes similar to those described abovein connection with Steps 440 and 450. The executed process, however, mayautomatically identify and select the set of control stores that are thebest match for each individual test store. For example, the processcould select the set of control stores whose performance patterns mostclosely mirror each test site in the period leading up to the start ofthe initiative. Once appropriate control sites are identified, theexecuted process may assign these sites in the control group used foranalyzing the initiative.

In addition, aspects of the invention allow client 118 and/or server 130to notify users of computer systems operating in business locations 114of proposed initiatives being developed and/or selected by the user ofclient 118 and/or a software process executing at client 118 (Step 480).For example, server 130 may generate email messages that include datareflecting a proposed initiative generated by a user of client 118. Theemail messages may be directed to one or more users (e.g., managers,marketing personnel, etc.) of business locations 114. Additionally,initiatives developed by a user associated with one of businesslocations 114 may be identified in an email message that is sent toother users of other business locations 114, client 118, and/or server130. Alternatively, or additionally, a central database may bemaintained by server 130 and/or business management unit 116 thatincludes data reflecting initiatives developed or under development byusers associated with business locations 114. When a new initiative isadded to the central database, server 130 and/or client 118 may send anotification to selected users of business locations 114 reflecting theaddition of the new initiative. The user may access the central databaseto review the updated information. Accordingly, information associatedwith developed initiatives, or initiatives under development, is sharedacross some or all users associated with business locations 114 and/orclient 118 to assist in creating and selecting an initiative to apply toa group of test sites.

V. Executing the Designed Initiative

As described above in connection with Step 230 of FIG. 2, after theinitiative is selected and designed, it is executed. FIG. 5A shows aflowchart of an exemplary initiative execution process, consistent withcertain aspects related to the present invention. Execution of theinitiative may include performing the necessary tasks associated withthe initiative at each of the business locations 114 designated as testsites. To manage the execution, client 118 and/or server 130 maygenerate and provide a checklist for the initiative to a user associatedwith each business location 114 (Step 510). In one aspect, the checklistmay include a plurality of tasks that need to be performed in order toexecute the initiative. To manage this across the test sites, client 118may request feedback from the test sites associated with the taskslisted in the checklist. Thus, as a task is performed, a user orsoftware process associated with a test site may provide feedback toclient 118. For instance, FIG. 5B shows a screen shot of an exemplaryWeb page 500 that includes a checklist of tasks 502 for an exemplaryinitiative. As shown, checklist 502 associates each task with a personresponsible for performing or overseeing the task, and an indicationwhen the task was completed. In accordance with certain aspects, a userassociated with a test site may update information associated with theprogress of the completed tasks for an initiative using Web page 500, ora similar form of user interface. The test site user may leverage acomputer system to send the updated information to client 118, oralternatively, client 118 may independently access the updatedinformation via a central database that stores the information oncereceived by the test sites.

In addition to a checklist, client 118 may provide to users associatedwith the test sites notifications corresponding to one or more eventsassociated with an initiative (Step 520). For example, client 118 mayexecute a process (via server 130 or independent of server 130) thatgenerates email messages that are automatically sent to the usersassociated with the test sites (e.g., a manager of a store). The emailmessage may indicate an upcoming initiative start date. Further, theusers associated with the test sites may send email messages to a userassociated with business management unit 116 indicating that theinitiative has started or ended at their respective test site and/orthat that particular tasks have been completed according to the giveninitiative. For instance, a manager associated with business managementunit 116 may send an email message to a test site manager to determinewhether a new product display was set up on an expected date in adesignated location according to a particular initiative. Also, byleveraging the shared data structure aspects of the present invention, auser associated with a test site may notify business management unit 116that the execution of an initiative under test may be delayed for somereason. In this manner, business management unit 116 is kept current onthe actual start dates of the initiatives for each test site, thusallowing analysis of the results of the initiatives to be adjustedaccordingly.

Based on the information provided by the users associated with the testsites, client 118 and/or server 130 may monitor execution of theinitiative (Step 530). Monitoring may include determining whether testsites are complying with scheduled events associated with an initiative.Based on the determination, client 118 and/or server 130 may update areport that monitors the progress of an initiative on an individual testsite basis or on an overall test site basis. The report may be providedto selected users of business management unit 116 and/or users of thetest sites for the initiative. In this manner, the initiative iscoordinated between the test sites and a central location (e.g.,business management unit 116).

During, or following the completion of an initiative, each test site mayprovide test site initiative result data reflecting informationassociated with one or more performance metrics associated with theinitiative under test. Client 118 may collect the test site initiativeresult data and store this information for subsequent analysis. Further,because financial result data may be continuously and automaticallytransferred from all sites to client 118, aspects of the inventionenable client 118 and/or server 130 to collect result data associatedwith any initiatives being performed by business network 110.

VI. Analyze Test Results of an Initiative

Test site initiative result data is analyzed to determine an appropriatemodel that generates estimated performance metric data that is accuratein relation to the control sites selected for the initiative. To analyzethe result data, client 118 may download information to server 130associated with the results of the test initiatives at the test sites.Also, result data is collected from control sites. Further, server 130may receive, or retrieve, attributes associated with each businesslocation 114 from client 118, such as store size, locations, sale data,types of products and/or service offered, location and distances ofcompeting merchant sites, age of the business location, amount of alease (if any), weather during the test period, staff information, etc.Alternatively, or in addition to the information provided by client 118,server 130 may execute software that determines, collects, and/orretrieves attribute information associated with business network 110,regions 112-1 to 112-N (e.g., population and demographic data, etc.),and business locations 114. The attribute information may be stored indatabase 140 for subsequent use by server 130 and/or client 118. Server130 implements segmentation engine 137 to perform a segmentation processthat segments test site result data against predefined attributes, suchas business location size or demographics, to identify business locationenvironments where the initiative work best.

VII. Create and Implement Initiative Rollout Plan

Once the user and/or server 130 has analyzed the segmented results, auser and/or server 130 can select and execute an appropriate model to beused for analyzing the initiative performed in the test sites andpredicting the impact of the initiative if extended to non-test sites.For example, server 130 may be configured to execute the selected modelusing information related to the test sites to identify the attributesthat are deemed most relevant to the success of certain test sites thatimplemented the initiative. Server 130 uses the test site information totrain the selected model. The user and/or server may analyze the resultsof the executed model to determine that the model is predicting accurateperformance metric data based on the actual initiative feedback dataprovided by the test sites. Then, server 130 may apply the model to thenon-test sites in order to predict how the performance of those siteswould change if the initiative was extended to them.

Selecting and executing a model may be performed in a manner similar tothat described in connection with FIGS. 3A and 3B of U.S. applicationSer. No. 10/767,191. For example, server 130 may offer different typesof modeling methodologies that are used to predict performance values ofthe test and/or control group sites, such as linear regression, stagedlinear regression, neural network basic train, neural network stepwiseregression, decision tree, K-means similar site modeling, and any othertype of software model that may be used to analyze the informationproduced server 130 during the initiative analysis process. Once a modelis selected, server 130 may query the user for parameters and other typeof information used by the selected model. For example, the user mayselect the type of performance metric to run in the selected model.Further, server 130 may allow the user to select which attributes areavailable for consideration by the selected model when executed. Theuser may identify attributes for consideration via a user interface,such as Web page 1300 illustrated and described in connection with FIG.13 of U.S. application Ser. No. 10/767,191.

Additionally, analyzing the results of the executed model may beperformed in a manner similar to that described in connection with FIG.3B of U.S. application Ser. No. 10/767,191. For example, once the modelis executed, server 130 may generate and render the results to the user,via client 118. In one aspect, server 130 may generate a model resultsweb page that includes information pertaining to the results of theexecuted model. The model results web page may include details of theattributes selected by the model. Additionally, the model results pageprovide information showing the average impact of each attribute on themodel results. Moreover, server 130 may provide information showing howaccurate the model predicts performance values of the test sites basedon the selected parameters (e.g., attributes) and the initiative. In oneaspect, server 130 may provide quantitative measures reflecting thefitness of the model for predicting and analyzing the performance valuesof the test sites. Additionally, server 130 may provide confidencemeasurements reflecting quantitative values of how well each attributeis actually contributing to producing a model that will successfullypredict the performance metrics of the non-test sites when implementingthe initiative.

The user of business management unit 116 uses the model resultinformation to determine whether the selected model and/or attributesare acceptable. Alternatively, a software program executed by client 118and/or server 130 may analyze the information produced by the executedmodel to determine whether the model and/or attributes considered by themodel are acceptable based on predetermined rules. If the results arenot acceptable the user and/or software program may re-select a model,attributes, and/or parameters for analyzing the initiative. For example,the user may remove one or more attributes from consideration prior tore-execution of the selected model. If, however, the results areacceptable, the user and/or software program may direct server 130 toapply the model to a selected number of business locations 114 (e.g.,non-test group sites) to determine a predicted impact of the initiativeon these sites. The server 130 may do this by applying attributes andtheir corresponding coefficients selected by the model to each non-testsite's values for those attributes. In doing so, server 130 calculatesthe predicted performance of the initiative on each non-test site basedon that site's relevant attributes.

In another aspect of the invention, a user may utilize the segmentedanalysis results and models generated by server 130 to evaluate severaltested initiatives simultaneously and select which initiative toimplement in a rollout to each business location 114. For example, asdescribed in U.S. patent application Ser. No. 10/767,191, models may bebuilt that estimate the impact of an initiative if it was applied toselected business locations 114 in business network 110. In accordancewith certain aspects of the invention, a user may analyze comparableinitiatives, and based on the analysis, designate the initiative that ismore profitable for rollout.

FIG. 6 shows a flowchart of an exemplary comparable initiative analysisprocess consistent with these aspects of the present invention. Asshown, a user may direct client 118 and/or server 130 to execute aprocess that identifies comparable initiatives (Step 610). Initiativesare comparable when they include ideas or tasks that are similar or areassociated with similar products or tasks. For example, initiatives maybe comparable if they involve displaying the same product in differentlocations of a business location 114. Alternatively, the initiatives maybe comparable if they involve displaying different products in the samelocation of a business location. Thus, in the previous examples, eitherthe product was the same, or the task was the same (i.e., displaying aproduct in a given location). Other characteristics associated withinitiatives may be used to determine whether they are comparable and theabove examples are not intended to be limiting. Further, it should benoted that there may be any number of comparable initiatives identified,such as two, three, or more initiatives.

As such, in one aspect of the invention, client 118 and/or server 130may execute a process that analyzes information stored in the centraldatabase associated with previously executed initiatives. The executedprocess may compare parameters associated with the previously executedinitiatives to identify similar facets of different initiatives, such assimilar performance metrics, attributes, performance results, categoryinformation etc. Based on the analysis, client 118 and/or server 130 mayidentify the comparable initiatives. In another aspect, client 118and/or server 130 may generate a user interface including a list ofcomparable initiatives from which a user may select for analysis.Alternatively, the user may leverage client 118 and/or server 130 toaccess the central database that stores information associated withpreviously executed initiatives in order to identify comparableinitiatives. As such, a user operating client 118 may designate whichinitiates are comparable and are to be included in the analysis processby providing input to client 118.

Once comparable initiatives are identified, client 118 and/or server 130may analyze the results of executed models associated with each of thecomparable initiatives (Step 620). The comparison may be based on aselected performance metric that was monitored and modeled in each ofthe comparable initiatives, such as sales. Based on the comparison,client 118 and/or server 130 may identify the initiative that has thebest estimated impact in relation to the performance metric for eachsite and designate the identified initiative for rollout to that site(Step 630). Based on the identification, client 118 may display resultsreflecting the relationship between the comparable initiatives for eachsite. A user operating client 118 may view the results to determinewhich initiative to implement to rollout to each site. Alternatively,client 118 and/or server 130 may execute a process that analyzes theresults to identify the more profitable comparable initiative(s) foreach site based on their estimated performance metric results. Thus,aspects of the invention enable a user or a software process executed byserver 130 and/or client 118 to assign the most profitable initiative toselected business locations 114 in business network 110 based on theestimated performance values generated by the executed models for eachof the comparable initiatives.

As described above in connection with Steps 250 and 260 of FIG. 2, oncean initiative has been tested, analyzed, and modeled, it may be selectedfor rollout. Thus, a rollout plan is created. In one aspect, aninitiative may be selected for rollout based on the performance resultsassociated with the test sites included in the initiative. Further, theactual business locations that should be included in the rollout mayalso be identified. Thus, once server 130 applies a tested model to thenon-test group sites and the test sites, and a determination may be madeas to those sites having the highest or more acceptable predictedperformance metric values. Server 130 may rank the sites accordingly andprovide this information to the user via client 118. For instance,server 130 may identify those sites that have an estimated larger saleslift when implementing the initiative than those who have lowerestimated sale values. The user may select one or more of businesslocations 114 to implement the initiative. Accordingly, the user, or asoftware process executed by server 130 and/or client 118, analyzes theinformation provided by model processing engine 138 and server 130 tomake an informed decision on which sites to implement the initiativetested at the test sites. Along the same lines, the user may also selectthose sites that should not implement the proposed initiative.

Additionally, consistent with certain aspects of the invention, methodsand systems of the present invention leverage the shared data aspects ofthe present invention to enable a user and/or a software process toproperly, create, schedule, and manage implementation of the rollout. Inone aspect, the calendar graphical representations made available byclient 118 to business locations 114 may be used to schedule a rollout.For instance, users of business locations 114 may access and view a datastructure, such as a calendar showing all business locations 114 thatare assigned an initiative and/or are currently executing an initiative.Reviewing the data structure, a user of a business location 114 maydetermine that a planned rollout of a particular initiative will disruptthe performance of another initiative or the performance metric of thebusiness location. As such, the user may use the data structure or othernotification mechanisms, such as those described above in Section V, tonotify a manager of business management unit 116 that the rollout of aninitiative will be delayed. The manager that operates client 118 may usethis information to update the data structure to reflect the new rolloutdate for the initiative by the affected business location.Alternatively, client and/or server 130 may execute a process thatautomatically updates the data structure to reflect the new rolloutdate.

Based on the information provided by users associated with businesslocations 114, a user associated with business management unit 116 mayadjust a rollout of an initiative for some or all business locations 114in business network 110. Alternatively, client 118 and/or server 130 mayexecute a process that automatically adjusts the rollout date of theinitiative based on the information received from business locations114. Thus, aspects of the invention implement business management unit116 and/or server 130 as a central location that shares data associatedwith the status and progress of initiatives among business locations 114and business management unit 116 that enables a user (e.g., a manager)of a business location 114 or business network 110 to manage theexecution of initiatives that have been selected for rollout.

IV. Conclusion

Variations of the methods and systems consistent with features of thepresent invention previously described may be implemented withoutdeparting from the scope of the invention. For example, server 130 maybe configured with software that automatically performs some or all ofthe analysis and decisions performed by a user operating client 118. Theprocesses described herein are not intended to be limiting and otherprocedures may be performed by software processes executed by server 130and/or client 118 to supplement and/or compliment those decisions, datainput, and analysis performed by a user.

Also, although the processes associated with certain aspects of thepresent invention are described in connection with web server andbrowser software for exchanging information between business locations114, client 118 and/or server 130, methods and systems consistent withaspects of the invention may use any type of technology to allow a userto send and receive information between the components of FIG. 1.Further, although the above described aspects of the invention includecommunications between a client 118 and a server 130, methods andsystems consistent with aspects of the invention are not limited toclient-server network configurations. That is, a user associated withbusiness network 110 may leverage a computing environment that is local(i.e., same computing system) to a system operated by the user.

Further, methods, systems, and articles of manufacture, consistent withfeatures of the present invention may be implemented using variousnetwork models, and is not limited to a particular computer and/ornetwork environment. Furthermore, methods, systems, and articles ofmanufacture, consistent with features of the present invention are notlimited to the implementation of systems and processes compliant anyparticular type of programming language. Any number of programminglanguages may be utilized without departing from the scope of thepresent invention.

Additionally, although aspects of the present invention are described asbeing associated with data stored in memory and other storage mediums,one skilled in the art will appreciate that these aspects can also bestored on or read from other types of computer-readable media, such assecondary storage devices, like hard disks, floppy disks, or CD-ROM; acarrier wave from the Internet; or other forms of RAM or ROM.Accordingly, the invention is not limited to the above described aspectsof the invention, but instead is defined by the appended claims in lightof their full scope of equivalents.

1. A computer-implemented method for developing and managing a businessinitiative in a business network including business locations, themethod comprising: developing, by a computer, an initiative to apply tothe business network; determining, by a computer, a number of test sitesto form the set of test sites based on a confidence value reflecting anestimated measurement of confidence that a measured change inperformance in those test sites is statistically meaningful; designing,by the computer, a test for the initiative using the determined numberof test sites, wherein designing the test for the initiative includes:accessing a data structure that includes information reflecting thestatus of any existing initiatives assigned to any of the businesslocations in the business network; and selecting the business locationsthat correspond to the test sites based on the status information,wherein the selected business locations do not have any existinginitiatives; producing, by the computer, a list of business locations tobe included in the initiative; wherein designing the test for theinitiative includes selecting a set of control sites that correspond tobusiness locations that do not execute the initiative during thedesigned test; and determining whether the set of control sites areappropriate for the initiative based upon a comparison between the setof test sites and the selected control sites.
 2. Thecomputer-implemented method of claim 1, wherein selecting the businesslocations that correspond to the test sites includes: displaying thedata structure; receiving a request to search the data structure basedon a desired business location; and receiving an input designating aparticular business location as one of the test sites.
 3. Thecomputer-implemented method of claim 1, wherein selecting the businesslocations that correspond to the test sites includes: analyzing the datastructure based on a desired business location; and designating aparticular business location as one of the test sites based on theanalysis of the data structure.
 4. The computer-implemented method ofclaim 1, wherein determining whether the set of control sites areappropriate for the initiative includes: measuring the relationshipbetween performance patterns of the control sites and performancepatterns of the test sites during a selected period of time before anexecution date of the initiative at the test sites.
 5. Thecomputer-implemented method of claim 4, further including: determiningthat the set of control sites are appropriate for the initiative whenthe measurement of the relationship between the performance of thecontrol and test sites has a value within a predetermined thresholdvalue.
 6. The computer-implemented method of claim 4, further including:displaying the relationship on a user interface; and receiving an inputfrom a user reflecting whether the control sites are appropriate for theinitiative.
 7. The computer-implemented method of claim 4, furtherincluding: selecting a new set of control sites that correspond tobusiness locations that do not execute the initiative during thedesigned test when the set of control sites are not appropriate for theinitiative.
 8. The computer-implemented method of claim 7, whereinselecting a new set of control sites includes: receiving input from auser identifying the new set of control sites.
 9. Thecomputer-implemented method of claim 1, wherein designing the test forthe initiative includes: automatically selecting a set of control sitesfor each test site whose performance patterns are most similar toperformance patterns of each test site over a period of time.
 10. Acomputer-implemented method for developing a business initiative, themethod comprising: developing, by a computer, an initiative to apply toa business network including business locations; creating, by thecomputer, a rollout plan for implementing the initiative at a first setof business locations; identifying comparable initiatives that have beenpreviously executed in the business network by selected businesslocations; analyzing results of executed software models that estimatethe impact of each comparable initiative if it was applied to selectedbusiness locations in the business network; identifying one of thecomparable initiatives for implementing at the first set of businesslocations; wherein creating the rollout plan includes providing aproposed rollout plan for the initiative to the first set of businesslocations; receiving feedback from a first business location in thefirst set associated with the proposed rollout plan; adjusting therollout plan based on the feedback from the first business location;generating a data structure reflecting the proposed rollout plan; andproviding the data structure to the first set of business locations. 11.The computer-implemented method of claim 10, wherein the identifiedcomparable initiative is used to create the rollout plan.
 12. Thecomputer-implemented method of claim 10, wherein identifying comparableinitiatives includes: analyzing information associated with previouslyexecuted initiatives; and identifying the comparable initiatives basedon the analysis of the information.
 13. The computer-implemented methodof claim 10, wherein identifying comparable initiative includes:displaying information associated with previously executed initiatives;and receiving input from a user identifying the comparable initiatives.14. The computer-implemented method of claim 10, wherein analyzingresults of models that estimate the impact of each comparable initiativeincludes: analyzing estimated performance results for each comparableinitiative reflecting an estimated performance of each initiative ateach site in the business network.
 15. The computer-implemented methodof claim 14, wherein identifying one of the comparable initiativesincludes: selecting the comparable initiative having the highestestimated performance at each location or set of locations.
 16. Thecomputer-implemented method of claim 10, wherein adjusting the rolloutplan includes: updating the data structure based on the feedback fromthe first business location.
 17. The computer-implemented method ofclaim 10, wherein adjusting the rollout plan includes: displaying thefeedback to a user; receiving input from the user reflecting changes tothe rollout plan; and adjusting the rollout plan based on the inputreceived from the user.
 18. The computer-implemented method of claim 10,further including: providing the adjusted rollout plan to the first setof business locations.